DOCUMENT RESUME 



BD 109 142 



TM 004 519 



AUTHpB 
TITLE 

PUB DATE 
NOTE 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Ellison," Robert L.'; And Others ' . . 

The Measurement of Academic Climate in 'Elementary 

Schools. k 

[73] — , ' • . . 

1Up r ; Expanded .version of pajjjgr presented at 'the 
Annual Meeting of the AmeriSSTn Psychological 
Association (81 st , Montreal, Canafda,* 1973) 1 

'mF-$q/76 HC- : $1.5a- PLUS f POSTAGE 

*Cla§sroom Environment; ^Classroom Participation-; 
Elementary Education; Elementary School Students; 
Fe^aback; Grade 5; Grade 6; Multiple Choice Tests; 
♦Questionnaires; *School Attitudes; *Student 
Attitudes ; Student Pa rticipation ; Teacher Behavior; 
Teachers; Test Construction * 
^Student Activities Questionnaire 



ABSTRACT 

T 

The measurement, of academic climate in terms of 
educational processes and their effect'on student outcome measure can 
make an important contribution to v the achievement of educational ' • 
goals by providing feedback to teafchers on their teaching methods, 
yielding new information concerning student perceptions, ideritifiying 
staff training needs, and by serving as a program evaluation tool. 
The Student Activities Questionnaire (SAQ), was constructed to obtain 
such information .by utilizing the consumers of the educational 
"system — the students themselves. This paper rSgpdews th£ development 
and rationale of the instrument and the results obtained to date. 
Academic climate and. the effects on students' was measured via a 
behayioraj-ly focused, multiple-choice questionnaire, administered to 
X 65U e-xperimental and control students in the 5th 4r and 6th, grades. 
Eight measures were developed through item analysis, techniques to 
provide academic climate scores, information oi^specific classppom 
activities, and student outcome measures. The .exp.ecimejital group 

* significantly exceeded the control group l on 7 comparisons. Individual 
class averages varied from the 20th to beyond the 80th percentile .on 
the various scores, indicating the instrument measured differences in 

.^academic 'climate and could provide valuable feedback for the 
educational system. (Aut hor/Dr!P) 
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Academic climate was measured in terms of educational processes 
and effects on students via a behavioral ly focused, multiple 7 choice 
questionnaire administered to 654 experimental and control students 
in the 5th and 6th grades. Eight measures were developed through 
item analysis techniq\ies to provide academic climate scores, infor- 
mation on specific classroom activities, and student outcome measures. 
The experimental group significantly exceeded the control group 'on 7' 
comparisons , Individual class averages varied from the 20th to beyond 
the 80th percentile on the .various scores, indicating the instrument 
measured differences in academic climate and colild provide valuable 

• V / ■ 

feedback -for the educational system. 
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J Expanded version of paper presented at the American Psychological 
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The Measurement of Academic Climate in Elementary Schools 

Robert L. fdlison, Andy Callner, David G, Fox , - * 

Institute for Behavioral^Research in Creativity' 
Calvin W. Taylor* 

* 

University of Utah . t , 

r' 

The measurement of academic climate in terms of educational processes 
and their effect on student^ outcome measures can make an important contri- 
bution to the achievement of educational goals by providing feedback to 
teachers on their teaching methods, yielding neu information concerning 
student perceptions, identifying staff training needs, and by serving as 
a program evaluation tool*.. The Student, Activities Quest ionaaire (SAQ-) 
was constructed to obtain such information by utilizing* the consumers of 
the educational* %ystem--the students themselves. This paper will review 

. the development and rationale of the instrument and the results obtained 

, to date. 

» 

The impetus for the construction of the ^AQ was an evaluation of Title 
III Project IMPLODE \>hich was concerned with developing** and eval uat ing 
multiple talent teaching procedures so that students could develop potential 
•v across five talent areas (Creativity, Communication , Decision Making, 
Planning, and Forecasting) in addition to academic subject matter (Taylor % 
1971; Guilford, 1967). It was believed that the teaching processes would 
result in significant differences in academic climate' as well as higher 
levels of student performance in the talent N areas . 



9 

ERIC 



_2 



* 



Procedure 



As a result of ^interviews with students and teachers and t observations \ 
of classes-, an item* pool was generated and a number of scores were tent a- 4 

■> 

V" tively developed and refined. ^Whenever possible, items were written with t 
a behavioral focus, that is, the st^ident^was asked to respond to items in f 
terms of whether o^: not specific events occurred, how often they occurred \ 

-% ■ 

what he did in reaction to these events, etc., to provide specific # . * 

information ab^iit teaching behaviors and their implications. The' intent 1 

in th% construction- 1 of the SAQ ^as to emphasize the impact of the educational 
-*% • 

"proc^s-s ratner than* the input to the educational system, i.e., the traits 
or abiliti/es of the students. 

t When a large pool of preliminary items had been generated and reviewed, 
pilot questionnaires were prepared and administered to approximately 600 • 
stude/ts in the experimentaf and control schools. The items were then 
keyed, on an a priori, judgmental basis directed toward the theoretical 
concept behind each score. Following this procedure, data were item 
analyzed, i.e., each item alternative was correlated with each score 
utilizij^ biserial correlations to evaluate the original classification 
and item writing system. In essence, this procedure provided item-score 
correlations for each item alternative across all scores. A number of 

r i 

items were then dropped and others were rewritten in order to obtain mor^ 
homogeneous measures and greater^differentiation across the individuals 
studied. A revised form of the SAQ containing 60 multiple-choice items 
was then developed and administered to 654 students in the 5,th and 6th grade's. 
The score descriptions and results in the next section were obtained^ from 
item analysis of this revised version of the SAQ. 




1. ENJOYMENT OF SCHOOL - This score measures the students' enjoyment, of 
class activities and school work. Students with "high scores indicate that ' 
they like what .they do in school and that they*-are frequently excited about 
the day's happtfhings. They report that they often like to stay in at recess, 
lunch, or after school to finish some classwork or project. They also 

report being excited about going to school in the morning and often tell ^ 
their parents abdVit go^d*experiences ■ in school. 

2. INDEPENDENT DEVELOPMENT - This score measures the degree of self-directed 
development wljich the students exhibit by engaging in developmental activities 
outside of the classroom. Student? with high scores* in this are^ indicate 
that they often worl on something at home just for the learning experience 
and they often practice doing something in order to improve the skill. They 
often rea(f books, newspapers, or magazines at home, and frequently take home 
many library books/ They also report that they have started new activities 

at home as a result of school experiences, and have brought up home activities 
in class discussions. • , , 

3. REINFORCEMENT OF SELF-CONCEPT - This score measures the amount of positive 
feedback received by the student, either through personal contact or structured 
class activities. It" is also a measure of the student's perception of this 
feedba&k arid his feelings about it v Students wi-th high scores' in this area 
indicaye that their teacher frequ^tly talks,,to them indiyidually about'their 
work, bhlers encouragement for difficult tasks, and gives frequent positive 
feeclftack for good performances. These students also report that, they feel 
enc6uraged when they receive* feedback and consequently develop pride in their 
schoolwork. In addition to good teacher contact, they also report that they 
have frequent class-activit ips where students have the opportunity to give 
each other feedback' regarding good work. 

4. CLASSROOM PARTICIPATION Th is" score measures student^ participation in 
classroom activities/ The individual items in the score- involve frequency 
of classroom discussions , number of students that typically participate, 
and opportunities for participation in the classroom. High scares in this 
area indicate frequent class discussions and activities. where many students 
are called on or given the opportunity to speak. They also indicate that 
students have the opportunity to work with a variety of other students on 
group projects and are often given the opportunity to teach each other. 

5. ' DEMOCRATIC ' CLASSROOM CONTROL , - This* score is a measure of strident input 
into classroom decision making, planning of individual 'activities and 
enforcement of, rules. Students with high scores in this, area feel that they 
a*e allowed frequent, input through discussions and planning activities, such 
that decisions are made through the joint e.ff^Vt of tea<^ier and students. 
They^lso indicate that, their teacher will permit a noi syNclassroom during 
many activities and stresses .student participation rather rlyan authoritarian 
control. a, , N 

5. it 



6. CAREER DEVELOPMENT : This score measures pie extent that classroom ' . 
activities facilitate the development of general skills basic to a broad 
range of vocations and to general* personal maturity. The items in the 1 , 
score measure leadership skills > planning, interacting with co-workers, 
organization and presentation of ideas, and evaluation and decision making. 

Classroom activities relating to these areas gave the student training 
in many of the^skiHs necessary for a successful vocational caree4f v and the 
development of general maturity. For example giving individual reports 
to the class may later relate to presenting ideas to an employer or a 
business meeting of associates. Evaluating a class project may later relate 
to the appraisal of one's own efforts or a product to be produced. * 

Defined^in this way, this score gives a general indication of the extent 
of relevan^nand' useful activities^ >that involve principles applicable beyond 
the classroom and are personally useful towards the development of individual * 
maturity and vocational skills. ^ ^ * ^ / 

7. INDIVIDUALIZATION OF INSTRUCTION - This score measures the extent'that 

students perceive their teachers as sensitive to their ovn\ individual needs, 

progfess, and goals. High scores in this area reflect students who talk 

privately with their teachers about* themselves and their school work and 

feel that their teachers are sensitive to their strengths , and weaknesses 

and the kinds of activities they enjoy. They further indicate -that the 

difficulty level of their classwork is neither too hard nor too easy and 

that activities are most often individualized -to meet the needs and 

abilities of each student. * 

* * » * 

a. MULTIPLE TALENT EXPERIENCE - This score measures the extent that activities 
connected with Multiple Talent Teaching. occur in the classroom. The items 
in this sc6re mea^urfc a variety of activities in the five 'talent areas of 
planning, decision making, forecasting, creativity and communication. High 
scores reflect extensive experience with the talent development techniques' 
used in Multiple Talent Teaching. 

* 

I 

The first three scores in the SAQ were constructed as outcome measures, 

while the others were directly concerned with process'. However, because 

• . . t * 

items were worded within the context of the school situation whenever , 

possible, the Enjoyment of School and Reinforcement of Self-Concept scores 

al'so contain items concerned with educational processes. • 4 

When mean scores were "compaYed for the control and experimental ^ 

school Sj the experimental school exceeded the control schools on each 

h ■ ' * • 



of the 8 comparisons. All but the Individualization of Instruction score 
-were significantly different, at or beyond the .05 levejt' <\f confidence. 
Since the control schools also had special programs in the area of indivi- 
dualization of instruction this , exception was nof surprising. These data 

indicated -"that the experimental teaching program* resulted in significant. 

• 2 ' 

differences in ^cademic climate. 

t * «# 

As shown in Table" 1, all of the SAQ measures were ^lativel^ indepen- 

** ✓ 

dent with varied' intercorrelations ranging from .18 to ~T4?L. except for the 
Multiple Talent Teaching and Career Development scores, which contained 
some common, items. Although not shown in the Table, the control variables 

• of grade and' sex had only trivial correlations with SAQ scores, except fo'r 
%he relationship between sex and the Enjoyment of School- score C r= - 26) 

N^which ii)</icatedthat girls enjoyed school more than boys in t;he sample - ^ 
studied. ,** 1 <fc 

The item analysis and i^tercorrelation results provided information 
concerning various teaching strategies and their relationships^ the academic 
Climate measures and the outcome scopes. The Enjoyment of School score 
g-enerally had moderate but consistent correlations with all of the cither SA$ 
scores indicating that those activities and teacher behaviors contributing, to 
high scores in other areas would also* increase sttfldents 1 . enjoyment Qf school. 
In particular, students with high scores on Enjoyment pf School perceived 



The students were also evaluated with specially constructed* instruments 
to as-sess performance in each- of the 5ntalent areas. Briefly, the expefi- 
mental s-chool exceeded the control school on each of the 18 comparisons made, 
with 8 .of the 18 significant at or beyond the .05 level of cpnfidence. 
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their teachers more willing to encourage and reinforce expression of 
their ideas through activities such as thinking up new ideas, practicing 
decision making ^ and guessing the future. * 

The Independent Development score was related to a number of teacher 
related activities, e.g., a high score in this area indicated a great deal 
of discussion in the classroom antf fr^guent discussions with teachers * • * 
involving the student's work". These results suggested that a loosely^l ^ 
-^structured democratic classroom, in combination with personalized -guidance 
on the part of thq* teacfter, could influence the Independent Developmeht 
score in a positive direction. 

The Reinforcement of Selvf,- Concept score .had low to moderate relation- 
ships with each of the other scores. Among these moderate relationships, 
/ - 

the highest wer^with Individualization of Instruction, Classroom Partici- 
pation, and Enjoyment of School. This is understandable, since individu- 
aliivition efforts and greater opportunities for classroom participation 
-* f should contribute to the reinforcement of the student's self-concept and 
enjoyment of school: The. classroom activities which were associated with 

( 

high self-concept scores' Included : praatice in decision making, making up 
- advertising ideas, setting personal goals ,* having frequent class discussions, 
\ahd making plans for the school day. It' would seem that, wjiile the teacher 

V - fc ' . . . • . 

has an important primary responsibility to" help develop the student's self- 
concept, thosp activities^which allow the student himself to build his 
Lesteemymay be as important as tfie reinforcement suppl-ied. These data also 
/ indicated that it is important to provide a variety of opportunities for 
success rather than limiting classroom activities to a comparatively small 
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number of intcl icctua 1 'processes . t < 

' I ' ' * \ 

The first part of the output from the SAQ«scoring system presents 

' * / * 

the percentile standing of each student on each of the 8> scores; This i 
information can be important in'helping the teacher relate to '^dividual 
students. For example, .a low score on Lnjoyment of School and a high 
score on Independent Development indicates that the student has highly ' x 
developed interests, hobbies; and other activities independent of school 
activities. ^If feasible , 'these activities can be explored and integrated 

with class projects to increase the student's enjoyment of school. Another 

• * > 

interesting pattern is students with low reinforcement of self-concept and, 

individualization of instruction scores. Tliis suggests that the sXudent 
haX a great desire for attention and needs frequent support in his acti- 



vities. Similar 'Interpretations can be used from various other combi- 
nations of scores. . . i 

/ 

This computer output of scores 'can also^ include suggestions for 

• * to" 

teach'ers on methods for increasing students 1 scores across the 8 measures. 
•A variety of strategies are possible for supplying this information. For 

L * 

example, suggestions could* be presented for onl'y the 3 lowest scores of 

a particular class. Samples of -this prescriptive output are^ presented in 
» 

Table 2. This information is' only given for consideration by teachers 

and should be used \}\ conjunction with other information based upon his ^ 

experience andWnowledge ck the classroom situation. 

From a diagnostic, staff developmenfcsViewpoiuJ: , the SAQ was very 

sensitive to difference\ in academic (/limaye a* illustrated by a .comparison 

' •* * 

/ 
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of tne mean scores for eaflrh of the classes studied, Table 5 presents' a 
frequency distribution of 'the classes studied in terms. of student percentile 
scores « , , t • - * *- 

As the table ^llusfrates , when the individual student scores were ' 
averaged for each of the classes 0 studied, one class had a mean scgrc at 
the 30th percentile on the Enjoyment of^School scored twq> cTasse's scored 
at about the 4bth percentile, etc, -The SAQ was thas very sensitive to 
'differences irj aeademic climate as the s-cor^s for the classes studied, varied 
widely. "Vhe mean scores ofifihe individual cl'asses studied varied from 



approximately the 20th to over the 80th percentile ©n the various SAQ scores. 

It is bel ieved -that information concerning, academic climate as described 
by students could facilitate the* attainment of a broad range of educat ionaL - * * . 
objectives, particularly those concerned with affective ^educat ion, by pro- 1 

• * * ^/ 

viding feedback to teachers which cafn foster more effective relationships 

' ' v . • '. . . ' 

with students. Present re-sults also indicated that the instr^ent has potenti-al 
for other applications including use as a program evaluation tool. * 
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